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The goal of this work was to quantify the uncertainty and sensitivity of commonly used 
turbulence models in Reynolds- Averaged Navier- Stokes codes due to uncertainty in the 
values of closure coefficients for transonic, wall-bounded flows and to rank the contribution 
of each coefficient to uncertainty in various output flow quantities of interest. Specifically, 
uncertainty quantification of turbulence model closure coefficients was performed for tran- 
sonic flow over an axisymmetric bump at zero degrees angle of attack and the RAE 2822 
transonic airfoil at a lift coefficient of 0.744. Three turbulence models were considered: the 
Spalart-Allmaras Model, Wilcox (2006) k-u Model, and the Menter Shear-Stress Trans- 
port Model. The FUN3D code developed by NASA Langley Research Center was used 
as the flow solver. The uncertainty quantification analysis employed stochastic expansions 
based on non- intrusive polynomial chaos as an efficient means of uncertainty propagation. 
Several integrated and point-quantities are considered as uncertain outputs for both CFD 
problems. All closure coefficients were treated as epistemic uncertain variables represented 
with intervals. Sobol indices were used to rank the relative contributions of each closure 
coefficient to the total uncertainty in the output quantities of interest. This study identified 
a number of closure coefficients for each turbulence model for which more information will 
reduce the amount of uncertainty in the output significantly for transonic, wall-bounded 
flows. 
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I. Introduction 

Turbulence is one of the greatest unsolved mysteries of classical physics. Due to the highly complex and 
chaotic nature of the phenomenon, the current physical understanding of turbulence is incomplete. Efforts 
have been made to create turbulence models to predict turbulent flows by using computational fluid dynamics 
(CFD); however, the lack of physical knowledge has forced modelers to use dimensional analysis and other 
methods to identify several constants, called closure coefficients, which balance the model equations. The 
numerical values of the closure coefficients in current turbulence models are chosen by using a combination 
of heuristic and empirical decision making. While modelers typically use experimental data to validate their 
choice of closure coefficients, a turbulence model is not guaranteed to be universally valid for any arbitrary 
flow. 

The goal of this work was to quantify the uncertainty and sensitivity of commonly used turbulence models 
in Reynolds- Aver aged Navier-Stokes (RANS) codes due to uncertainty in the values of closure coefficients 
for transonic, wall-bounded flows and to rank the contribution of each coefficient to uncertainty in various 
output flow quantities of interest. Specifically, three turbulence models are considered: the Spalart-Allmaras 
One-Equation Model (SA), 1 the Wilcox (2006) k-uj Two-Equation Model (W2006), 2 and the Menter Shear- 
Stress Transport Two-Equation Model (SST). 3 Each model features its own unique set of closure coefficients, 
which are discussed further in Section III. 

Fun3D, an unstructured RANS code of NASA Langley Research Center (LaRC), was chosen as the flow 
solver for all simulations in this work. More information about Fun3D is included in Section II. A. Two 
CFD problems are considered in this work. The first is an axisymmetric, transonic bump validation case 
from Bachalo and Johnson, 4 which is discussed in detail in Section II. B. The second CFD problem is the 
RAE 2822 transonic airfoil, which is discussed in detail in Section II. C. 

To minimize the large computational expense associated with uncertainty quantification of high-fidelity 
CFD simulations with traditional sampling methods (e.g., Monte Carlo), stochastic expansions based on 
non-intrusive polynomial chaos (NIPC) are used as an efficient means of uncertainty propagation in this 
work. 5 All closure coefficients were treated as epistemic uncertain variables (i.e. , uncertainty due to lack 
of knowledge and not due to inherent, systemic uncertainty). Sobol indices, 6 which are global nonlinear 
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sensitivity indices based on variance decomposition, were used to rank the relative contributions of each 
closure coefficient to the total uncertainty in the output quantities of interest. For the transonic bump, the 
output quantities of interest are drag coefficient, pressure coefficient, skin friction coefficient, and separation 
bubble size. For the RAE 2822, the output quantities of interest are lift coefficient, pressure and skin friction 
components of drag coefficient, and pressure coefficient. 

In Section II, an overview of the flow solver and CFD test problems is presented. In Section III, the 
details of each of the turbulence models considered here are discussed. A summary of the closure coefficients 
and their domains is presented for each model. In Section IV, the Uncertainty Quantification (UQ) analysis 
and computational expense is discussed in further detail. In Section V, the results of all UQ analyses are 
presented. Finally in Section VI, conclusions are made and some suggestions for future work are presented. 

II. Flow Solver and CFD Test Problems 

In this section, the flow solver and CFD test problems are discussed. First, the details of the selected 
solver are provided. Next information is given for the freestream conditions and meshes of each CFD test 
problem. 

II. A. Flow Solver 

All flow solutions in this work were obtained by using a modified form of Fun3D version 12. 4. 7 Fun3D 
is an unstructured, node-based, three-dimensional, finite-volume RANS code capable of solving steady and 
unsteady laminar or turbulent flows with subsonic to hypersonic speeds. The modifications to the code were 
performed to allow changes to the values of turbulence model closure coefficients in the uncertainty analyses. 
All solutions used a Roe, second-order flux differencing scheme with no flux limiter and second-order spatial 
accuracy for the viscous terms. The CFL numbers for the mean flow and turbulence model equations were 
ramped from 10 to 50 and from 5 to 30, respectively, across 500 iterations, and then the CFL numbers were 
fixed at their maximum values until steady-state convergence was achieved. 

II. B. Problem 1: Axisymmetric Transonic Bump 

The first CFD problem considered in this work is an axisymmetric transonic bump validation case from 
Bachalo and Johnson. 3 4 The test article in the experiment consisted of a thin-walled cylinder that extended 
61 cm upstream of the bump’s leading edge, and the cylinder had an outside diameter of 15.2 cm with a 
bump chord of 20.32 cm. The flow has freestream M = 0.875, T = 540 °R, and Re = 2.763 x 10 6 (based 
on the bump length of c = 1). All flow solutions were obtained by using the 721 x 321 grid from the 
NASA Langley Research Center turbulence modeling resource website. 8 The mesh contains 462,882 nodes, 

I, 155,121 edges, and 230,400 hexahedral cells. It consists of a 1° wedge rotated about the x-axis. The sides of 
the mesh are treated as periodic interfaces; they are periodic with each other and rotated through 1° in order 
to simulate axisymmetry. The surface of the bump and cylinder has a solid wall boundary condition, and all 
other boundary conditions are farfield Riemann. A graphical overview of the axisymmetric transonic bump 
problem is included in Fig. 1. The circles below the mesh in the figure represent the axisymmetry about the 
x-axis. An example pressure contour plot is included in Fig. 2 for the transonic bump case obtained with 
the SA baseline model. 

II. C. Problem 2: RAE 2822 Transonic Airfoil 

The second CFD problem considered in this work is the RAE 2822 transonic airfoil at a lift coefficient 
of 0.744. The experimental data for this case is from Cook and McDonald. 9 The flow has freestream 
M = 0.729, T = 540 °R, and Re = 6.5 x 10 6 (based on the airfoil chord of c = 1). Numerical integration 
of the experimental pressure coefficient data yields a lift coefficient of Cl = 0.744; the angle of attack was 
adjusted for each baseline turbulence model to match this value, and all subsequent simulations for each 
model used the same angle of attack as the one found for the baseline. All flow solutions were obtained 
by using a 513 x 161 grid containing 206,272 nodes, 514,208 edges, and 102,400 hexahedral cells. The grid 
is a 2D C-mesh extruded one unit in the ^/-direction with ^/-symmetry boundary conditions on either side 
and with a solid wall boundary condition on the airfoil surface. All other boundary conditions are farfield 
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Figure 1. Axisymmetric transonic bump overview from Ref. 8. 


Riemann. A graphical view of the RAE 2822 grid is included in Fig. 3. An example pressure contour plot 
is included in Fig. 4, which was obtained with the SA baseline model. 

III. Turbulence Models 

In this section, the details of the turbulence models employed in this work are outlined. Each subsection 
contains an overview of a turbulence model, its closure coefficient values, and estimates of the epistemic 
intervals for each closure coefficient. Note that the two-equation turbulence model equations are written in 
conserved variable form, but the flow solutions are calculated with primitive variable form. Note that in this 
work, the nomenclature from the NASA LaRC turbulence modeling website 8 is used. 



Figure 2. 


Non-dimensional pressure contours (scaled with the freestream value) of axisymmetric transonic bump. 
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Figure 3. The computational grid around the RAE 2822 transonic airfoil. 



III. A. Spalart-Allmaras One-Equation Model (SA) 

The SA model was developed as an evolution of the Nee-Kovasznay model, 10 but with several near- wall and 
compressibility corrections. 1 It is simpler, less computationally expensive, and more computationally robust 
than multi-equation models, and it is widely used for aerodynamic flows in engineering applications. The 
model is given by 


dO 

dt 
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The full formulation of the model is given by Spalart and Allmaras. 1 The closure coefficients and their 
suggested values are given in Table 1. The closure coefficients also include 
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and p is the density, v = p/p is the molecular kinematic viscosity, and p is the molecular dynamic viscosity. 
Additional definitions are given by the following equations: 
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where U = yj 2 WijWij is the magnitude of the vorticity, d is the distance from the field point to the nearest 
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According to Spalart and Allmaras, 1 the following constraints should be enforced: 


(6) 


a G [0.6, 1.0] (7) 

cti e [ 0 . 1 , 10 ] ( 8 ) 

cts > 1.0 (9) 

c v i > 6.9 (10) 


Spalart and Allmaras also note in Ref. 1 that c t2 is “not a candidate for much adjustment,” and that c t 4 can 
be decreased some, but that “values much smaller than 1 would start affecting the results in the turbulent 
region.” Bailey et al. 11 determined that k = 0.40 ± 0.02 in their turbulent pipe flow experiments, and this 
range of k was used for all of the turbulence models examined in this work. In private communication with 
the first author, 12 Spalart recommended using the bounds of Fig. 1 in Ref. 1 to determine the epistemic 
intervals of c&i, 2 , and c w2 . Spalart also recommended that 


c w3 G [1.75,2.5] 


(ii) 


In total, eleven closure coefficients were varied in the UQ analysis for SA. A summary of the SA closure 
coefficients to be varied, and their associated epistemic intervals are included in Table 1. 


III.B. Wilcox (2006) k-u Two-Equation Model (W2006) 

The k-cj model utilizes two equations to model a turbulent kinetic energy and length scale determining 
variable. The first equation is for turbulent kinetic energy, &, and the second equation is for the dissipation 
per unit turbulence kinetic energy, uj. In 2006, Wilcox introduced a new version of the k-uo model which 


Table 1. SA Closure Coefficients and Associated Epistemic Intervals. 


Coefficient 

Standard Value 

Lower Bound 

Upper Bound 

a 

2/3 

0.6 

1.0 

K 

0.41 

0.38 

0.42 

Cyl 

7.1 

6.9 

7.3 

C W 3 

2.0 

1.75 

2.5 

Ctl 

1.0 

0.1 

10.0 

Ct 2 

2.0 

1.9 

2.1 

C t 3 

1.2 

1.0 

2.0 

0:4 

0.5 

0.3 

0.7 

Cbl 

0.1355 

0.12893 

0.13700 

0)2 

0.622 

0.60983 

0.68750 

Cw 2 

0.3 

0.05500 

0.35250 
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greatly improved its accuracy for free shear flows and strongly separated flows by introducing a cross-diffusion 
term and a built-in stress-limiter. 13 The W2006 model is given by 
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The full formulation of the model is given by Wilcox. 2 The closure coefficients and their suggested values 
are given in Table 2. The closure coefficients also include 
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In Ref. 13, Wilcox states that T *y/k ~ 3/10, so (3* = ( T xy/k) 2 ~ 9/100. From this description, the author 
assumed that T xy/k G [0.28,0.32], yielding /3* G [0.0784,0.1024]. Wilcox also states that P*/p 0 = 1.25 ±0.06 
and that the following inequalities must hold true: 


o do ± cr k a w (22) 

®k ± & do (23) 

In this study, the standard value of 1/8 was used for ado in all flow solutions. Acceptable ranges for a w 
and ak were established from inequalities (22) and (23) and from Figs. 4.16 and 4.17 in Ref. 13. In private 
communication with the first author, 14 Wilcox stated that the standard value of Cu m was chosen mainly for 
applications with Mach number greater than two. For the transonic range, Wilcox recommended a value of 
Cum closer to one. 

In total, six closure coefficients were varied in the UQ analysis for W2006. A summary of the W2006 
closure coefficients to be varied and their epistemic intervals are included in Table 2. 
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Table 2. W2006 Closure Coefficients and Associated Epistemic Intervals. 


Coefficient 

Standard Value 

Lower Bound 

Upper Bound 

B* 

0.09 

0.0784 

0.1024 

Clim 

0.875 

0.75 

1.0 

K 

0.40 

0.38 

0.42 

070o 

1.2712 

1.19 

1.31 

Ow 

0.5 

0.5 

0.7 

Ok 

0.6 

0.5 

0.6 


III.C. Menter Shear-Stress Transport Two-Equation Model (SST) 

Menter’s SST model uses blending functions to combine the k-uj and k-e models. 3 The objective is to use 
the k-uj model in the near wall region where it is most accurate, and to take advantage of the freestream 
independence of the k-e model in the outer part of the boundary layer. The model is given by 
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The full formulation of the model is given by Menter. 3 The closure coefficients and their suggested values 
are given in Table 3. The closure coefficients also include 
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Each of the constants is a blend of an inner (1) and outer (2) constant, blended via 
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where 0 1 represents constant 1 and 02 represents constant 2. Additional functions are given by 
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Table 3. SST Closure Coefficients and Associated Epistemic Intervals. 


Coefficient 

Standard Value 

Lower Bound 

Upper Bound 

<7kl 

0.85 

0.7 

1.0 

°k2 

1.0 

0.8 

1.2 

&wl 

0.5 

0.3 

0.7 

®w2 

0.856 

0.7 

1.0 

P* 1 Pi 

1.20 

1.19 

1.31 

P* / P‘2 

1.0870 

1.05 

1.45 

/ 3 * 

0.09 

0.0784 

0.1024 

K 

0.41 

0.38 

0.42 

a i 

0.31 

0.31 

0.40 


where p is the density, v t is the turbulent kinematic viscosity, p is the dynamic viscosity, d is the distance 
from the field point to the nearest wall, and Cl is the vorticity magnitude. 

Menter states that, “It has been the author’s experience that small changes (5-10%) in modeling con- 
straints can lead to a significant improvement (or deterioration) of model predictions.” 3 Unfortunately, little 
more information is available regarding plausible domains for SST closure coefficients. Many of the SST 
closure coefficients are shared with W2006, and in these cases the same epistemic intervals from W2006 
were employed for SST. Georgiadis and Yoder 15 determined that a\ G [0.31,0.40]. Menter agreed with this 
assessment in private communication with the first author, 16 stating that “One can only increase a\ — 
decreasing it interferes with the log layer calibration.” 

In total, nine closure coefficients were varied in the UQ analysis for SST. A summary of the SST closure 
coefficients to be varied and their epistemic intervals is included in Table 3. 

IV. Uncertainty Quantification Approach 

Uncertainties in computational models fall into two categories: aleatory and epistemic. Aleatory un- 
certainties represent inherent variations in a system, whereas epistemic uncertainties arise due to lack of 
knowledge. (For example, the outcome of a coin flip is aleatory because it is due to inherent chance; however 
if a coin is placed on a table and covered up, the uncertainty in heads/tails is epistemic because it is due to 
a lack of knowledge.) In this work, all closure coefficients are treated as epistemic uncertain variables due 
to the lack of a complete physical understanding of turbulence. 

Rather than resorting to Monte Carlo simulations for uncertainty quantification, stochastic expansions 
based on Point- Collocation Non-Intrusive Polynomial Chaos (NIPC) were employed to reduce computational 
expense. 5 The strategy of Point- Collocation NIPC is to create a surrogate model via least squares approach 
(i.e., polynomial response surface) by using the CFD output obtained at a number of Latin Hypercube 
sample points for the propagation of uncertainty. An explanation of Point-Collocation NIPC given by 
West et al. 17 follows. With the polynomial chaos approach, a stochastic response function a* (e.g., drag 
coefficient, pressure or skin friction coefficient at a given point in the flow field) can be decomposed into 
separable deterministic and stochastic components within a series expansion: 

p 

«*(*,£)» ( 34 ) 

4=0 

where on is the deterministic component and 4q is the random variable basis functions corresponding to the 
i th mode, a* is assumed to be a function of a deterministic vector cc, which includes the spatial coordinates 
and deterministic parameters of the problem, and of the n-dimensional standard random variable vector 
In theory, the series in Eq. (34) is infinite, but for practical implementation of the polynomial chaos 
expansions it is truncated and a discrete sum is taken over a number of output modes, (P + 1). Further 
details on polynomial chaos theory are given by Ghanem 18 and Eldred. 19 

There are three parameters that determine the number of samples required to generate the response 
surface: the number of uncertain variables, n; the order of the response surface polynomial, p ; and the 
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oversampling ratio, n p . The total number of samples, N s , is then given by 


N s = n p ■ (P + 1) = n p 


( n + p)\ 

nlpl 


( 35 ) 


The Point-Collocation NIPC method starts with replacing a stochastic response or random function 
with its polynomial chaos expansion in Eq. (34). Then, N s vectors are chosen in random space and the 
deterministic code (the CFD flow solver in this case) is evaluated at these points; this is the left-hand side 
of Eq. (34). Finally a linear system of N s equations is formulated and solved for the spectral modes of the 
random variables. This system is given by: 


a*(*,€o) \ 


( *o(£o) *l(£o) ••• *p(€o) ) 



a*(*,€i) 

= 

ttotei) tfitei) ••• -M6) 
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\ ^o(£(iV s -l)) VliZiN.-l)) ••• ^p(€(N s - 1)) / 


\ ap J 


An oversampling ratio of 1.0 yields the minimum number of samples required to produce a response 
surface. Hosder et al. 20 demonstrated that an oversampling ratio of n p = 2.0 gives a better approximation 
to the statistics at each polynomial degree they considered. For this reason, n p = 2.0 was used for all of 
the UQ analyses in this work. Given n p > 1.0, Eq. (36) is overdetermined and can be solved using a least 
squares approach. In the current work, a polynomial order of two (p = 2) was used for all UQ analyses. 

Sobol indices (global nonlinear sensitivity indices) were used to rank the relative contributions of each 
closure coefficient to the total uncertainty in the output quantities of interest. Sobol indices can be derived 
via Sobol Decomposition, which is a variance-based global sensitivity analysis method. This derivation 
utilizes the polynomial chaos expansion coefficients calculated in Eq. (36), and is included in Appendix A. 

Due to the bounded nature of epistemic input uncertainties, Legendre polynomials are used in this 
study as the basis functions. Although stochastic response surfaces created with the NIPC approach allow 
the calculation of confidence intervals along with various statistics of the output for probabilistic (aleatory) 
input, in this study only the maximum and the minimum of the response will be calculated from the response 
surface to determine the epistemic interval for each uncertain output. 

Initially all of the closure coefficients in Tables 1, 2, and 3 were used in the uncertainty quantification 
analyses. The results of these analysis are presented in the next section. The closure coefficients that 
contribute most to the uncertain outputs in the original analyses are then used as the uncertain variables 
in a second set of reduced-dimensionality analyses (RDA). The objective of the second set of analyses is to 
obtain more accurate response surfaces and Sobol indices for the significant closure coefficients. A summary 
of the computational cost (i.e., number of CFD evaluations required) of the transonic bump analyses is 
included in Table 4, and a summary of the computational cost of the RAE 2822 analyses is included in 
Table 5. 


V. Results 

The results of all uncertainty quantification analyses are presented in this section. The axisymmetric, 
transonic bump is discussed in Sections V.A and V.B; and the RAE 2822 transonic airfoil is discussed in 
Sections V.C and V.D. Finally, a comparison of the results from both CFD problems is discussed in Section 
V.E. 


Table 4. Number of CFD Evaluations Required for Transonic Bump UQ Analyses. 


Original Analysis RDA 


Turbulence Model 

n 

P 

Tip 

N. 

n 

P 

Tip 

N s 

SA 

11 

2 

2 

156 

6 

2 

2 

56 

W2006 

6 

2 

2 

56 

3 

2 

2 

20 

SST 

9 

2 

2 

110 

5 

2 

2 

42 
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Table 5. Number of CFD Evaluations Required for RAE 2822 UQ Analyses. 


Original Analysis RDA 


Turbulence Model 

n 

P 

Tl p 

N s 

n 

P 

TL p 

N s 

SA 

11 

2 

2 

156 

7 

2 

2 

72 

W2006 

6 

2 

2 

56 

3 

2 

2 

20 

SST 

9 

2 

2 

110 

5 

2 

2 

42 


V.A. Axisymmetric Transonic Bump - Original Analyses 

The purpose of the original uncertainty quantification analyses was to identify the closure coefficients that 
contribute significantly to uncertainty in the output quantities of interest. These coefficients were later used 
in reduced-dimensionality analyses. For the transonic bump, the output quantities of interest include drag 
coefficient (Cd)] pressure and skin friction coefficient distributions (C p and Cf ); and separation bubble size. 

Sobol indices were used to rank the relative contributions of each closure coefficient to the overall un- 
certainty in Cd- Coefficients with higher Sobol indices contribute more to the uncertainty than coefficients 
with lower Sobol indices. The Sobol indices of the closure coefficients for each turbulence model for Cd are 
presented in Table 6, where they are ranked from highest to lowest. The largest contributors to uncertainty 
in each model are typed in blue. Coefficients with Sobol indices of less than 3.0 xlO -2 were not considered 
to be significant. The closure coefficients retained for each turbulence model with this approach account for 
at least 95% of the total uncertainty in the output quantity of interest (Table 6). 


Table 6. Sobol Indices of Closure Coefficients for Cd • 


Coefficient 

SA 

Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

ft 

8.50xl0 _1 

O w 

7.75xl0 _1 

13 * 

8.03xl0 _1 

a 

5.99xl0 -2 

Clim 

1.42xl0 _1 

Owl 

9.24x10-2 

C-vl 

5.38xl0- 2 

P* 

1.26xl0 _1 

P* /Pi 

7.79x10-2 

Cw2 

2.59X10- 2 

Ok 

2.12x10-2 

P*/ (3 2 

3.54x10-2 

Cbl 

1.11x10-2 

ft 

1.99x10-2 

Ow 2 

1.85xl0 -3 

Q>2 

4.66xl0“ 4 

r//5 0 

7.46xl0" 3 

Ok 2 

1.21xl0" 3 

C-w3 

5.33xl0 -5 



CLi 

8.25xl0" 4 

Ct3 

9.71xl0 -6 



Oh cl 

4.91 xlO" 4 

Ctl 

8.91xl0 -6 



ft 

1.24xl0" 4 

0:4 

8.57xl0 -6 





Ct2 

5.13xl0 -6 






The largest contributors to uncertainty in Cd for the SA model are ft, cr, and c v \. The largest contributors 
for W2006 are cr w , C^ m , and /3*. The largest contributors for SST are /?*, a w i, /3*//?i, and /?*//? 2 . Note that 
/?* is shared by both the W2006 and SST models. Also note that o w \ in the SST model is the equivalent of 
a w in the W2006 model. Von Karman’s constant (ft) is included in all three models, but it is only significant 
to uncertainty in Cd for the SA model. 

Response surfaces for pressure coefficient (C p ) and skin friction coefficient (Cf) were generated at each 
axial location across the bump. Sobol indices for these coefficients were also calculated at each axial location. 
Plots of the Sobol indices for C p and Cf versus x were generated so that the closure coefficients significant to 
these quantities at points in the flow could be identified. These plots are included in Fig. 5. For clarity, only 
the Sobol indices of coefficients with significant contributions to uncertainty in C p are shown in the plots. 

The largest contributors to uncertainty in C p and Cf for the SA model are cr, ft, c v i, c w 3, 1, and c w 2. 

The largest contributors for the W2006 model are /?*, Cu m , and a w . The largest contributors for the SST 
model are a w 1 , /3*//3i, /5* / /^ 2 , /?*, and a\. 

The separation bubble size for each case of each model was taken as the difference between the x- 
coordinate of the zero-intersection points in the Cf versus x curves. Using the same process as before, 
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Sobol Index Sobol Index Sobol Index 


a 



(c) Sobol indices for C p versus x (W2006). (d) Sobol indices for Cf versus x (W2006). 




(e) Sobol indices for C p versus x (SST). (f) Sobol indices for Cf versus x (SST). 

Figure 5. Sobol index distributions for transonic bump (Original Analyses). 
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Table 7. Sobol Indices of Closure Coefficients for Separation Bubble Size. 


SA 

Coefficient Sobol Index 

W2006 

Coefficient Sobol Index 

SST 

Coefficient Sobol Index 

a 

5.58xl0 _1 

Clim 

7.26X10" 1 

0 * 

6.49xl0 _1 

K 

1.82xl0 _1 

0* 

2.57X10" 1 

&wl 

1.15xl0 _1 

C W 2 

1.54xl0 -1 

O w 

1.03X1CT 1 

CLi 

1.06xl0 _1 

Q>1 

6.74xl0 -2 


1.46xl0 -2 

0*10 2 

9.48xl0“ 2 

Ou3 

3.71xl0 -2 


9.92xl0 -3 

0*/0\ 

9.24xl0“ 2 

Cyl 

1.87xl0 -3 

P* / Po 

5.51xlCT 3 

&k2 

2.09xl0“ 2 

03 

6.76xl0 -4 



K 

1.70xl0 -2 

04 

6.05xl0 -4 



&w2 

1.36xl0 -2 

02 

5.98xl0 -4 



°kl 

9.77xl0 -3 

0)2 

5.68xl0- 4 





Ol 

5.56xl0 -4 






Table 8. Closure Coefficients with Significant Contributions to Transonic Bump. 


SA 

W2006 

SST 

a 

0 * 

®wl 

K 

Clim 

0*l0x 

Oil 


0*10 2 

C-w2 


0 * 

Cbl 


a 1 

Cw3 




stochastic response surfaces were created for the separation bubble size for each model. The Sobol indices 
of the closure coefficients for separation bubble size are given in Table 7. 

The largest contributors to uncertainty in separation bubble size for the SA model are cr, /c, c w 2 , c&i, and 
c w 3 . The largest contributors for the W2006 model are Cu m: /?*, and a w . The largest contributors for the 
SST model are /?*, a w i, ax, P* / P 2 , and P* / Pi- 

In sum, six closure coefficients were found to contribute significantly to at least one output quantity of 
interest for the SA model; three closure coefficients for the W2006 model; and five coefficients for the SST 
model. This information is summarized in Table 8 . 

V.B. Axisymmetric Transonic Bump - Reduced Dimensionality Analyses 

To further increase the accuracy of the uncertainty analysis by creating the stochastic response surface with 
a smaller number of uncertain variables, a reduced dimensionality analysis (RDA) was performed for the 
axisymmetric transonic bump with each turbulence model by using only the significant closure coefficients 
found in Table 8 . 

A baseline case was run with the standard set of closure coefficients for each turbulence model. Stochastic 
polynomial response surfaces of Cd were obtained with NIPC on the uncertain domain. The minimum and 
maximum values of drag coefficient (Cd) for each model were calculated from these response surfaces. To 
verify the accuracy of each response surface, additional CFD solutions were generated by using the sets of 
closure coefficients that produced the minimum and maximum values of Cd on the response surface; the Cd 
comparison between the response surfaces and the CFD is summarized in Table 9. In each case, the response 
surface is within 4.07% or less of the CFD. The difference values reported in Table 9 indicate an acceptable 
level of accuracy for epistemic uncertainty analyses. 

In the experiment, Bachalo and Johnson estimated the separation and reattachment points to be x = 0.70 
and x = 1.1 respectively. This yields a separation bubble size of 0A0(x/c) (based on the bump length of 
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Table 9. Drag Coefficient Results, in Drag Counts (RDA). 


Model 

Baseline Cd 
CFD 

Min Cd 
Resp. Surf. CFD 

Difference 

Max Cd 

Resp. Surf. CFD 

Difference 

SA 

2.232 

2.148 2.130 

0.85% 

2.270 2.288 

0.79% 

W2006 

2.226 

2.116 2.098 

0.86% 

2.243 2.224 

0.85% 

SST 

2.284 

1.813 1.890 

4.07% 

2.647 2.612 

1.34% 


Table 10. Separation Bubble Size Results (RDA). 



Baseline Size 

Min Size 

Max Size 



Model 

CFD 

Resp. Surf. 

Resp. Surf. 



SA 

0.467 

0.441 

0.507 



W2006 

0.535 

0.522 

0.672 



SST 

0.507 

0.000 

0.903 



Table 11. Sobol Indices of Closure Coefficients for Cd (RDA) 



SA 

W2006 

SST 

Coefficient 

Sobol Index 

Coefficient 

Sobol Index 

Coefficient 

Sobol Index 

K 

8.51xl0 _1 

® w 

7.26xl0 _1 

/?* 

7.95xl0 _1 

a 

6.08xl0 -2 

p * 

2.07xl0 _1 

&wl 

9.19x10-2 

C-vl 

5.35xl0- 2 

Clim 

1.89xl0 _1 

F/h 

7.96x10-2 

Cw2 

2.56X10- 2 



r //?2 

4.86x10-2 

Cbl 

1.08x10-2 



a i 

3.01X10- 3 

Cw3 

3.17xl0 -5 






c = 1). The separation bubble size results for the UQ analyses are included in Table 10. Originally, the SST 
response surface for separation bubble size yielded a negative minimum bubble size. This was due to the 
fact that for certain samples there was a very small, or even no separation region, yielding negative values 
for the response. Since this is not physical, the minimum value is set to zero. 

The Sobol indices for Cd and separation bubble size agree well with the Sobol indices in the original 
analyses. These values are included in Tables 11 and 12. The ranking of importance is mostly the same 
between the original and reduced-dimensionality analyses. Even when the ranking of importance is not 
the same, the actual numeric values of the Sobol indices in the reduced-dimensionality analyses are still 
reasonably close to their corresponding values in the original analyses. 

Response surfaces for pressure coefficient (C p ) and skin friction coefficient (Cf) were generated at each 
axial location across the bump. Sobol indices for these coefficients were also calculated at each axial location. 
The minimum and maximum possible values of C p and Cf were calculated at each axial location from the 
response surfaces. 

Plots of C p versus x were generated for all of the cases used in the UQ analysis, for each turbulence 
model. This was done to verify the physical feasibility of the solutions. Each plot contains data for the 
baseline case; UQ training cases (green lines); minimum and maximum C p bounds; and experimental data 
from Bachalo and Johnson. 4 The authors would like to emphasize that Bachalo and Johnson did not report 
any experimental uncertainty in their results, so the experimental data in these figures should be considered 
as reference only. A proper comparison with experiment should take into account the uncertainty both in the 
numerical model and experimental data, and the difference should be quantified with appropriate metrics 
for the validation of the numerical model. 

The C p versus x plots are included in Figs. 6a, 6c, and 6e. The Sobol indices for C p versus x are included 
in Figs. 6b, 6d, and 6f. For clarity, only the Sobol indices of coefficients with significant contributions to 
uncertainty in C p are shown in the figures. For each model, additional cases were run at the corners of 
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Table 12. Sobol Indices of Closure Coefficients for Separation Bubble Size (RDA). 



SA 

W2006 


SST 

Coefficient 

Sobol Index 

Coefficient 

Sobol Index 

Coefficient 

Sobol Index 

a 

5.79xl0 _1 

Clim 

7.49xl0 _1 

/?* 

6.27xl0 _1 

K 

1.84xl0 -1 

P * 

2.71xl0 -1 

P* /Pi 

1 . 86 xl 0 _1 

Cw2 

1.45xl0 _1 


7.63xl0 -2 

&wl 

1.37xl0 _1 

Cbl 

5.91xl0 -2 



13*/ 

1.24xl0 _1 

Cw3 

3.27xl0“ 2 



a 1 

7.99xl0 -2 

Cyl 

3.65xl0 -3 






the hypercube defined by the epistemic interval bounds of only the most significant closure coefficients; this 
was done to eliminate the effect of discontinuities in the response surfaces near the shock and to determine 
the epistemic uncertainty interval for the output in the shock region only. The C p minimum and maximum 
curves in Figs. 6 a, 6 c, and 6 e are piece- wise combinations of the NIPC response surfaces and these hypercube 
cases in the shock region. 

Note that each of the minimum and maximum C p curves may not in general correspond to one flow 
solution each, because each point along each curve is calculated from either the response surface generated 
by using the C p values of each UQ case at that specific x-location, or by one of the hypercube corner cases. 
While there exist flow solutions that pass through or very near to the minimum and maximum C p curves at 
each point, there is no flow solution that passes through all of the minimum or all of the maximum points. 

Plots of skin friction coefficient at each axial location were created in a similar fashion as the plots of 
pressure coefficient. Plots of Cf versus x for each UQ case are included in Figs. 7a, 7c, and 7e. As before, 
the minimum and maximum Cf curves in these figures are piece- wise combinations of the NIPC response 
surfaces at each axial location and hypercube corner samples in the shock region. The vertical lines in the 
plots are the separation and reattachment point locations reported by Bachalo and Johnson . 4 The Sobol 
indices for Cf at each axial location are shown in Figs. 7b, 7d, and 7f. 

Based on the reduced-dimensionality results, all of the coefficients found to be significant to the axisym- 
metric transonic bump in Section V.A are indeed significant to their respective turbulence models, even in 
the absence of possible numerical “noise” caused by the insignificant coefficients in the original analyses. Of 
the three turbulence models, the SST model is most sensitive to changes in its closure coefficients; this is 
evidenced by large variations in the model’s values for Cl> and separation bubble size, as well as the large 
solution bands for C p and Cf. The SA and W2006 models are roughly equally sensitive to changes in their 
closure coefficients. All of the models are most sensitive to changes in their closure coefficients in the shock 
and separated regions of the flow, particularly so in the latter region. None of the models exhibit large un- 
certainties in C p upstream of the shock or downstream of the reattachment point, however the uncertainty 
in Cf remains large in these regions. 

V.C. RAE 2822 Airfoil - Original Analyses 

As with the original analyses of the transonic bump, the purpose of the original analyses of the RAE 
2822 airfoil was to identify the closure coefficients that contribute significantly to uncertainty in the output 
quantities of interest. For the RAE 2822, the output quantities of interest include the lift coefficient (Cl), 
drag coefficient due to pressure (CL> press ), drag coefficient due to skin friction (CD sf ), and pressure coefficient 
distribution (C p ). The skin friction coefficient distribution was not investigated for the RAE 2822 because 
no separation bubble was observed in the baseline case solutions. 

In the same manner as for the transonic bump, Sobol indices were calculated for the output quantities 
of interest of the RAE 2822. The results for Cl, CL> press , and Co sf are included in Tables 13, 14, and 15 
respectively. 

For the SA model, the largest contributors to uncertainty in Cl are k, c t 4 , c t 3 , c v 1 , and q, 1 . The largest 
contributors to uncertainty in CL> press are cr, c w 2 , c&i, and c t 4 ; and the largest contributors to uncertainty in 
Cl) S £ are At, cr, c w 2 , c^ 4 , 3 , and c v \. 

For the W2006 model, the largest contributors to uncertainty in all three integrated quantities are C^ m , 
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(a) C p versus x (SA). 


a 



(b) Sobol indices for C p versus x (SA). 





(e) C p versus x (SST). (f) Sobol indices for C p versus x (SST). 

Figure 6. Pressure coefficient results for transonic bump. 
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a 




(a) Cf versus x (SA). 


(b) Sobol indices for Cf versus x (SA). 




(d) Sobol indices for Cf versus x (W2006). 




(f) Sobol indices for Cf versus x (SST). 


Figure 7. Skin friction coefficient results for transonic bump. 
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Table 13. Sobol Indices of Closure Coefficients for Cl of RAE 2822. 


Coefficient 

SA 

Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

K 

5.07xl0 -1 

Clim 

8.55xl0 -1 

F/h 

4.22xl0 -1 

CtA 

2.34xl0 -1 

P* 

9.57xl0 -2 

ai 

4.13xl0 -1 

Ct3 

1.82xl0 -1 


4.23xl0 -2 

p* 

2.50xl0 -1 

C-vl 

7.30xl0 -2 

K 

1.83xl0 -2 

°w2 

2.37xl0 -2 

Cbl 

3.18xl0 -2 

P*/Po 

1.27xl0 -2 

®wl 

1.64xl0 -2 

C-w2 

1.78xl0 -2 

°k 

1.19xl0 -2 

F/Pi 

1.59xl0 -2 

a 

1.55xl0 -2 



&k2 

l.llxlO -2 

Q>2 

1.51xl0 -2 



a hi 

9.95xl0 -3 

Cw3 

9.52xl0 -3 



K 

8.63xl0 -3 

Ctl 

8.12xl0 -3 





C t 2 

6.13xl0 -3 






Table 14. Sobol Indices of Closure Coefficients for Cd ss . 


Coefficient 

SA 

Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

a 

4.64xl0 -1 

Clim 

6.62xl0 -1 

/?* 

6.30xl0 -1 

C"w2 

2.13xl0 -1 


2.14xl0 -1 


2.36xl0 -1 

Cbl 

1.91xl0 -1 

P * 

1.71xl0 -1 

a 1 

1.34xl0 -1 

Cf 4 

7.10xl0 -2 

P*/Po 

4.81 xlO -3 

P*/Pi 

3.22xl0 -2 

Cy 1 

2.90xl0 -2 

K 

2.46xl0 -3 

Cwl 

1.18xl0 -2 

K 

2.74xl0 -2 

&k 

2.32xl0 -3 

cf w2 

l.llxlO -2 

C t 3 

2.07xl0 -2 



&k2 

4.99xl0 -3 

Cb2 

1.25xl0 -2 



Ckl 

4.71 xlO -3 

Ct2 

7.16xl0“ 3 



K 

1.95xl0 -3 

Ctl 

5.01xl0“ 3 





C W 3 

3.90xl0 -3 






/?*, and a w . The order of importance is different for Cl, Co pres s , and Cl> s£ , but the important coefficients 
are the same for each quantity. 

For the SST model, the largest contributors to uncertainty in Cl are /3*//?2, fli, and /?*. The largest 
contributors to uncertainty in CL> press are /?*, P* / P 2, &i, and P* Pi\ and the largest contributors to uncertainty 
in Cd b£ are /?*, cr^i, and P* / Pi. 

Response surfaces for C p were generated at each x-location on the top and bottom surface of the airfoil 
so that the closure coefficients with significant contributions to C p at any given point in the flow could be 
identified. These plots are included in Fig. 8. In Fig. 8a, the largest contributor to uncertainty in C p for 
the majority of the x domain in the SA model is k. There are also spikes in the Sobol indices of c t 3, c t 4, 
and ct, indicating that these coefficients are also important in some parts of the flow; particularly, spikes 
appear near the shock on the upper surface and near the high-pressure region at the leading edge on the 
lower surface. In Fig. 8b, the uncertainty in C p for the W2006 model is almost completely dominated by 
Cum, with only a few minor contributions from f3* and 02. In Fig. 8c, the uncertainty in C p for the SST 
model is mostly attributed to /3*//?2, /?*, and a\. At x « 0.6, a w 1 also has a minor contribution. 

In sum, seven closure coefficients were found to contribute significantly to at least one output quantity 
of interest for the SA model; three coefficients for the W2006 model; and five coefficients for the SST model. 
This information is summarized in Table 16. 
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a 



(a) Sobol indices for C p versus x (SA). 


P* 



(b) Sobol indices for C p versus x (W2006). 



(c) Sobol indices for C p versus x (SST). 

Figure 8. Sobol index distributions for RAE 2822 airfoil (Original Analyses). 
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Table 15. Sobol Indices of Closure Coefficients for Cn si - 


Coefficient 

SA 

Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

K 

5.65xl0 _1 


6.41X10" 1 

p* 

7.75X10" 1 

a 

2.36xl0 _1 

Clim 

2.39X10" 1 

&wl 

1.22X10" 1 

Or 2 

8.50xl0 -2 

P* 

1.56X10" 1 

P* /Pi 

9.50xl0 -2 

CtA 

4.30xl0“ 2 

K 

1.07xl0 -2 

a i 

9.84xl0 -3 

03 

3.58xl0 -2 

°k 

9.71 xlO“ 3 

P*/p2 

5.32xlCT 3 

Oil 

3.06xl0 -2 

P*/Po 

3.59xl0 -3 

&w2 

1.17xl0 -3 

Ol 

1.97xl0“ 2 



Ok\ 

8.58xl0 -4 

0)2 

1.65xl0 -3 



&k2 

8.34xl0 -4 

Ol 

1.36xl0 -3 



K 

1.30xl0" 4 

Or 3 

1.17xl0 -3 





02 

6.17xl0 -4 






Table 16. Closure Coefficients with Significant Contributions to RAE 2822. 


SA 

W2006 

SST 

< 7 

P* 

Ol 

K 

Clim 

P*/Pi 

Ol 

Cw 

P*/P2 

03 


P* 

04 


0-1 

Cbl 



Cw2 




V.D. RAE 2822 Airfoil - Reduced Dimensionality Analyses 

As with the transonic bump, a reduced-dimensionality analysis was performed on the RAE 2822 for each 
of the turbulence models to further improve the accuracy of the response surfaces used in the uncertainty 
analyses. A baseline case was run with each of the original, unchanged turbulence models for the RAE 2822 
airfoil. The response surfaces of drag coefficient and lift coefficient for the RAE 2822 were verified in the same 
manner as the response surfaces of the drag coefficient of the transonic bump; the minimum and maximum 
values of Cd and Cl were first calculated from the response surfaces, and then CFD simulations were run by 
using the closure coefficients that produced these minimum and maximum values. The comparison between 
the response surfaces and CFD is summarized in Tables 17 and 18. All of the Cd response surfaces are 
within 4.37% or less of the CFD, and the Cl response surfaces are within 1.18% or less of the CFD. 

The Sobol indices for Cl, Cn pre ss , and Cn si agree well with the Sobol indices in the original analyses. The 
results for the reduced-dimensionality analyses are included in Tables 19, 20, and 21. As with the transonic 
bump, the ranking of importance of the closure coefficients for each quantity is mostly the same between 


Table 17. RAE 2822 Drag Coefficient Results, in Drag Counts (RDA). 


Baseline Cd Min Cd Max Cd 


Model 

CFD 

Resp. Surf. 

CFD 

Difference 

Resp. Surf. 

CFD 

Difference 

SA 

146.0 

134.7 

135.8 

0.81% 

152.8 

151.2 

1.06% 

W2006 

142.3 

130.2 

128.5 

1.32% 

144.4 

144.4 

0.00% 

SST 

128.5 

107.2 

112.1 

4.37% 

183.0 

182.8 

0.11% 
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Table 18. RAE 2822 Lift Coefficient Results (RDA). 


: 

Model 

Baseline Cl 
CFD 

Min Cl 
Resp. Surf. CFD 

Difference 

Max Cl 
Resp. Surf. CFD 

Difference 

SA 

0.744 

0.735 

0.739 

0.57% 

0.769 

0.764 

0.69% 

W2006 

0.744 

0.733 

0.738 

0.68% 

0.749 

0.748 

0.13% 

SST 

0.744 

0.710 

0.719 

1.18% 

0.778 

0.774 

0.45% 


Table 19. Sobol Indices of Closure Coefficients for Cl of RAE 2822 (RDA). 


SA 

Coefficient Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

K 

5.09xl0 _1 

Clim 

8.96xl0 _1 

a i 

5.21xl0 _1 

C-tA 

2.18xl0 _1 

P* 

9.93xl0 -2 

0702 

3.27xl0 _1 

Q3 

1.81xl0 _1 


1.84xl0 -2 

/?* 

2.81xl0 _1 

C-vl 

1.03xl0 _1 




l.lOxlO -1 

a 

2.83xl0 -2 



&wl 

4.48xl0" 2 

Cbl 

2.60xl0 -2 





Cw2 

2.23xl0 -2 






the original and reduced-dimensionality analyses. Even when the ranking of importance is not the same, the 
actual numeric values of the Sobol indices in the reduced-dimensionality analyses are still reasonably close 
to their corresponding values in the original analyses. 

Pressure coefficient plots were generated for each turbulence model. Each of the plots contains data for 
the baseline case; UQ training cases (green lines); the minimum and maximum C p bounds; and experimental 
data from Cook et al. 9 Cook et al. did not report any experimental uncertainty, so the experimental results 
are included as reference only. The C p versus x plots are included in Figs. 9a, 9c, and 9e; and the Sobol 
indices for C p versus x are included in Figs. 9b, 9d, and 9f. For clarity, only the Sobol indices of coefficients 
with significant contributions to uncertainty in C p are shown in the figures. Similarly to the transonic 
bump, the minimum and maximum C p curves Figs. 9a, 9c, and 9e are piece- wise combinations of the NIPC 
response surfaces and cases run at the corners of the hypercubes defined by the epistemic bounds of the 
closure coefficients in the shock region. 

Based on the reduced-dimensionality results, all of the coefficients found to be significant to the RAE 
2822 airfoil in Section V.C are indeed significant to their respective turbulence models. Of the three models, 
the SST model is most sensitive to changes in its closure coefficients, as evidenced by its larger variations in 
Cl, C Dpress , and CA sf , and by its larger solution band for C p compared to the SA and W2006 models. The 
SA and W2006 models are roughly equally sensitive to changes in their closure coefficients, with the latter 
particularly insensitive. All of the models are most sensitive to changes in their closure coefficients in the 
shock region; everywhere else, there is very little uncertainty in C p . 

V.E. Comparison of Uncertainty Quantification Results Between the Two CFD Cases 

The uncertainty quantification and sensitivity results of the axisymmetric transonic bump and RAE 2822 
airfoil are consistent with one another. For the W2006 and SST models, every closure coefficient which is 
significant to at least one output quantity of interest for the transonic bump is also significant to at least 
one output quantity of interest for the RAE 2822 and vice versa. This agreement is nearly observed by the 
SA model as well, with only one coefficient significant to the transonic bump but not the RAE 2822, and 
only two coefficients significant to the RAE 2822, but not the transonic bump. A summary of all of the 
significant closure coefficients is included in Fig. 10. 

Compared to the transonic bump results, the RAE 2822 results are much less sensitive to changes in all 
three turbulence models’ closure coefficients. The same trends still apply however; the SST model is most 
sensitive to changes in its closure coefficients, and the SA and W2006 models are roughly equally sensitive 
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a 




(a) C p versus x (SA). 


(b) Sobol indices for C p versus x (SA). 



(c) C p versus x (W2006). (d) Sobol indices for C p versus x (W2006). 




(e) Cp versus x (SST). 


(f) Sobol indices for C p versus x (SST). 


Figure 9. Pressure coefficient results for RAE 2822. 
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Table 20. Sobol Indices of Closure Coefficients for Cx> preas of RAE 2822 (RDA). 


SA 

Coefficient Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

a 

4.55xl0 _1 

Clim 

7.01XHT 1 

/?* 

6.64xl0 _1 

Cbl 

2.24xl0 -1 

P* 

1.82xl0 _1 

P*/Pi 

2.02x 10 _1 

C"w2 

2.23xl0 _1 


1.64xl0 _1 

a i 

1.77X1CT 1 

Ct4 

5.26xl0“ 2 



P*/Pi 

5.15xlCT 2 

ft 

4.27xl0 -2 



&wl 

2.19xl0" 2 

C-vl 

3.19xl0 -2 





C£3 

2.17xl0 -2 






Table 21. Sobol Indices of Closure Coefficients for Cd s{ of RAE 2822 (RDA). 


SA 

Coefficient Sobol Index 

W2006 

Coefficient Sobol Index 

Coefficient 

SST 

Sobol Index 

ft 

5.69xl0 _1 


6.92X10" 1 

13 * 

7.91X10" 1 

a 

2.33xl0 _1 

Clim 

2.10XHT 1 

®wl 

1.15X1CT 1 

C w 2 

8.30xl0 -2 

P* 

1.45xl0 _1 

P* /Pi 

9.10xlCT 2 

Ct4 

4.25xl0“ 2 



a i 

1.09xlCT 2 

Cyl 

4.05xl0“ 2 



PVP 2 

3.68xlCT 3 

C3 

3.52xl0“ 2 





Cbl 

1.89xl0 -2 






to changes in their closure coefficients. Uncertainties in C p are particularly large in the shock region of each 
flow for all three turbulence models. 

The information presented in this paper is expected to be of interest to the CFD community because 
it demonstrates that large changes in turbulence model behavior can be observed by changing specific 
sets of closure coefficients. In particular, there are two main results that can enable the advancement of 
turbulence models used in RANS simulations. The first result is that if improved matching between CFD and 
experiments (i.e., the data representing the real physical phenomena) is desired, the Sobol indices presented 
in this work for certain output quantities of interest give clues for which closure coefficients to modify first. 
The second result is that if the aerospace community can reduce the uncertainty in only a certain set of 
closure coefficients (whether through experimentation, LES/DES, etc.), the uncertainty in turbulence model 
predictions can be greatly reduced. For example, the uncertainty in the value of Von Karman’s constant in 
the SA model was responsible for approximately 85% of the uncertainty in Cd of the axisymmetric transonic 
bump. If more information were known about the true value of ft, the results of the SA model would be 
much less uncertain. 

If improved accuracy is desired, a good starting point may be to first consider the integrated quantities; 
that is, Cd for the axisymmteric transonic bump, and Cl , CA press , and Cd s{ for the RAE 2822 airfoil. 
Referring back to Tables 11, 19, 20, and 21, a small number of closure coefficients can be identified for each 
turbulence model which consistently contribute to very large amounts to uncertainty in the output quantities 
of interest. These coefficients include ft and a for the SA model; Cu m and cr w for the W2006 model; and P* 
for the SST model. The authors suggest that these coefficients be considered first in future refinements of 
the turbulence models discussed here. 

VI. Conclusions and Future Work 

Two detailed uncertainty quantification studies focusing on turbulence model closure coefficients were 
performed on an axisymmetric transonic bump at zero degrees angle of attack and the RAE 2822 transonic 
airfoil at a lift coefficient of 0.744. The transonic bump has freestream M = 0.875 and Re = 2.763 x 10 6 , 
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Axisymmetric Transonic Bump RAE 2822 Transonic Airfoil Axisymmetric Transonic Bump RAE 2822 Transonic Airfoil 




(a) SA - Significant closure coefficients. 


(b) W2006 - Significant closure coefficients. 


Axisymmetric Transonic Bump RAE 2822 Transonic Airfoil 



(c) SST - Significant closure coefficients. 

Figure 10. Closure coefficients significant to uncertainty in at least one output quantity of interest for each CFD 
problem and for each turbulence model. 


and the RAE 2822 has freestream M = 0.729 and Re = 6.5 x 10 6 . The turbulence models considered were 
the Spalart-Allmaras Model, Wilcox (2006) k-cj Model, and Menter Shear-Stress Transport Model. The 
uncertainty quantification employed stochastic expansions based on non-intrusive polynomial chaos as an 
efficient means of uncertainty propagation. The drag coefficient, wall pressure and skin friction coefficient 
distributions, and shock-induced separation bubble size were considered as uncertain outputs for the transonic 
bump. The lift coefficient, pressure and skin friction components of drag coefficient, and wall pressure 
coefficient distribution were considered as uncertain outputs for the RAE 2822. Sobol indices were used to 
rank the relative contributions of each closure coefficient to the total uncertainty in the output quantities of 
interest. This information can be used a potential starting point in the future advancement of the turbulence 
models considered here, and it is a first step towards quantifying model-form uncertainty. 

Based on the results, the following conclusions can be made: For the SA model, the coefficients that 
contribute most to uncertainty in the output quantities of interest are cr, ft, c v i, c&i, c w 2, c t 3, c t 4, and c w 3. 
For the W2006 model, the coefficients that contribute most to uncertainty in the output quantities of interest 
are /?*, Cum, and cr w . For the SST model, the coefficients that contribute most to uncertainty in the output 
quantities of interest are a w 1 , /3*//?i, /3*//?2, /?*, and a\. With the exception of c w 3 , c t 3 , and c t 4 in the SA 
model, all other closure coefficients were found to be significant to both the axisymmetric transonic bump 
and RAE 2822 transonic airfoil. 

In the future refinement of the models discussed here, the authors suggest that studies should focus 
on increasing knowledge of appropriate values for ft and a for the SA model; Cum and a w for the W2006 
model; and /3* for the SST model. Improved knowledge of the values of these particular closure coefficients 
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will have the largest impact on reducing the uncertainty in integrated quantities of interest for the RANS 
simulations of wall-bounded transonic flows. Future work should also focus on determining why certain 
closure coefficients contribute more or less to uncertainty at different flow locations. For example, research 
should be done to determine why a in the SA model becomes important to Cf for the transonic bump after 
the reattachment point, but not before. Finally, future work should include more CFD problems, particularly 
in three dimensions. 
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Appendix A: Sobol Index Derivation 


In this section, the derivation of Sobol indices is presented. First, the total variance, D , can be written 
in terms of the PCE as shown in Eq. (37). 


D = Zafa *)(*?(!)) 

M 

Then, as shown by Sudret 6 and Crestaux et ah, 21 the total variance can be decomposed as: 


(37) 


D — Di + Dij + Dij]^ + • • • + Di j2 n (38) 

i=l 1 <i<j<n 1 <i<j<k<n 

where the partial variances (Dq,...,^) are given by: 

lh t a /3 (^(f)) > 1 <ii < ... <i s <n (39) 

Then the Sobol indices (Sq...* s ) are defined as, 


which satisfy the following equation: 


Si. 


D, 


D 


i=n i=n— 1 i=n— 2 

Si + Sij + yy Si J j j fc + ---+si J 2,...,n-=i-o 

2=1 l<2<j<n l<2<j<fe<n 


(40) 


(41) 


The Sobol indices provide a sensitivity measure due to individual contribution from each input uncertain 
variable (Si), as well as the mixed contributions ({S*j}, {Sijj c }, • • • ). As shown by Sudret 6 and Ghaffari et 
ah, 22 the total (combined) effect (SVJ of an input parameter i is defined as the summation of the partial 
Sobol indices that include the particular parameter: 


St . i = T] ^ = {(*!,... ,i s ) : 3 fc, 1 < k < s, i k = i} (42) 

For example, with n — 3, the total contribution to the overall variance from the first uncertain variable 
(i — 1) can be written as: 


St i — S i + Si, 2 + Si ; 3 + Si ? 2,3 (43) 

From these formulations, it can be seen that the Sobol indices can be used to provide a relative ranking of 
each input uncertainty to the overall variation in the output with the consideration of nonlinear correlation 
between input variables and output quantities of interest. 
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